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^7 IT l t 

METHOD FOR THREE-DIMENSIONAL IDENTIFICATION OF 
OBJECTS ~7?*c^c^^^ a^-r^e t ^~"Z-><*~ 

The invention is directed to a method for fast three-dimensional 
A 

identification of objects, particularly for identifying faces. Such methods can be 
utilized in checking an access authorization for specific rooms or buildings or, 
respectively* for-an access authorization for specif ic^autemats. 

There is an increasing need for extremely secure monitoring systems in 
conjunction with access authorization to specific things such as, for example, 
-automatic teller machines. A -plurality of person-specific features 4s thereby 
checked. The recognition of the face is thereby accorded a significant part. 

Various security systems are already in field trials. For example, the check 
or chip carcUs-t o be cit e d -faere, a number of features of the face of the owner, being 
eapable-of-being-stored-thereon. A user only receives access when, for example, 
a coding number as well as features of the face recognized by the automatic unit 
coincide with stored data. The coding number is, for example, -the PIN (personal 
identification number). The -face features are extracted from a gray-scale image 
registered by a video camera. This-"i3~thereby essentially -a^-matteF^ef simple 
geometrical identifiers in one plane such as, for example, the eye spacing, *he 
spacing between mcmth and eye aeeess, etc. Despite the relatively indefinite 
relationship between a two-dimensional gray-scale image and the actual shape of 
the face, which is essentially clearly three-dimensionally expressed, extremely good 
results can already be achieved with known evaluation methods such as, for 
example, with neural networks. The recognition dependability hitherto lay at 
approximately 98%. A critical disadvantage of the previous methods is that these 
can be fooled relatively easily such as, for example, with a photograph held in 
front of the face. 

For three-dimensional object recognition, it is known to employ the 
principle of encoded light application in conjunction with triangulation. The 
critical feature of this measuring principle lies in the space-time encoding of the 
work space to be measured,^the object surface. The work space is illuminated by 
a chronologically successive projection of, for example, stripe patterns (gray- 



encoded stripe patterns). The stripe patterns thereby enable the distinction of 
different projection directions that are characterized by a characteristic light-dark . 
J) sequence. For three-dimensional -measuring of an object scene, the patterns, 

A A 

generated with the assistance of a transparent LCD (liquid crystal device) and 

c c 

5 /) deformed at th e object s of the scene y are observed by a camera from a direction 

rf.'fW.*- " ...... 

differing from the illumination direction. 

Given known -peskkm- between camera, projector and object scene, the 
three-dimensional coordinates of the observed scene can be calculated by 
triangulation in a conventional way. 
10 The previously known employment of transparent LCDs as light- 

modulating, optionally transparent elements involves a comparatively long 
acquisition time since the LCDs exhibit very long switching times. This approach 
$ is unsuitable for -a- fast acquisition (for example, 0.1 seconds for a personal 
identification). 

15 A rapidly switchable light modulation element that, moreover, can be 

versatilely driven is known from therompany-pxibKcatic^ 

Larry J:Hornbeck, Digital Light Processing and MEMs: Timely Convergence For 
A Bright Future, Texas Instruments45digital Imaging Components, Dallas/Texas 
2 0 75265, 23. - 24 Oct. 1995", Austin, Texas, USA. 

A digital micro-mirror arrangement (DMD, Digital Micromirror Device) 
described therein can accomplish a digital light processing (DLP). This light- 
f\ modulating element is composed of a plurality of mirrors micro-mechanically 
applied on an integrated circuit (chip), these being drivable individually or in 

2 5 A groups. The- plurality - of mirrors can amount to up to 48,000 per chip. Normally, 

a DMD chip can be driven with an 8-bit word, as a result whereof 256 gray scale 

^ steps derive. Since this light-modulating element is initially used for-a-television 

is 

A or, re spectively , video applications, further data are-correspondingly based on 
video-technical devices. A critical feature, however, is comprised therein that the 

3 0 switching times lie in the range of microseconds. The reproduction of a television 

image is thus enabled by employing, for example, a three-color illumination of the 



chip, whereby the DMD chip is correspondingly electronically driven. The image 
n presented by the -plurality of correspondingly driven mirrors can be projected onto 
a screen. An optical element of the described type can thus generate a high 
resolution and a very good contrast. ifZ r , c ^ 

5 The A invention is based on the object of acquiring the topography of three- 

dimensional objects by encoded illumination and with television picture 
processing significantly faster without thereby significantly increasing the system 
costs. 

^p^s-objeGt^s-achk^ 

/3 In addition to the-evaluatien-o£-the two-dimensional images, -the-evaluation- 

A A 
of three-dimensional face shapes can be utilized according to the invention, this 

-containing significantly more extensive and more dependable information. The 

fi advantages resulting therefrom lie in-a. recognition dependability -th at is . highe r by 

^ /) *i 4 * ^ 

15 /J -factors, as a result whereof a considerably greater-plurality of persons can be 

/) identified? Contours or sections in different planes-<^n-then-be utilized as features 

for recognizing a three-dimensional surface. A basic prerequisite for a fast 

recognition with extremely high recognition dependability is the complete and 

correct acquisition of the surface topography. Triangulation in conjunction with 

2 0 an encoded illumination is available as a method. Given the known gray code 

illumination, a stripe pattern is projected onto the object, the periodicity thereof 

being varied. For example, the numbers of lines are doubled. Given n different 

periodicities that are registered in n images, two super n depth planes are obtained 

given this method. Accordingly, at least six different encoded images are required 

2 5 for 64 depth planes. This method requires a fast switching of the illumination 

images since the recognition procedure given a real face registration must be ended 
in a very short time because a person generally does not stand still for very long. 
The liquid crystal modulators currently available for this purpose require a time 
span of approximately 0.1 seconds for the information registration for three- 

3 0 dimensional acquisition. New possibilities are opened up in this approach by the 

substitution of the liquid crystal modulator. This is inventively achieved by a 




micro mirror modulator (DMD, Digital Micromirror Device, DMD microchip). 
. ^ This element, which is composed of a plurality of switchable micro mirrors that 
J\ can be individually driven, is4n-the-p€>skiefl-to-appl-y an encoded illumination 
onto a three-dimensional surface, whereby different illumination patterns can be 
5 generated with high resolution and high contrast. Over and above this, this can 

ft occur with adequately high switching frequency, so that a-pkirality of images can 
be sequentially acquired in a short time for light encoding methods. 

Over and above this, the invention also enables the um] 
utilization of an encoded illumination with different colors, so that three depth 
10 fl planes can be simultaneously already acquired with one television frame. The 
evaluation of the three color channels of red, green and blue of a color camera is 
thereby used. 

The combination of encoded illumination, the digital micro mirror system, 
as well as color image processing ideally supplies the fast acquisition and high 
15 recognition dependability for the recognition of three-dimensional objects, for 

example for *eeegntzi*ig-face. A face identification system of this type can be 

A C/ft^fcVu Crc^^o-OC^'j 

*ft realized of cost-beneficial G0mpenents-of-consumer.electroniGS. 



f The invention enables the introduction of directly acquired three- 
dimensional data of the human face for personal identification. In general, a 
2 0 method for fast, high-resolution and cost-beneficial acquisition of the three- 
dimensional data of a human face is made available, whereby the combination of 
an encoded illumination with a digital micro mirror element is utilized. The color 
image processing can be optionally added and reduces the acquisition time to one- 
third. ■ , 

^py 5 : Ck 1 / 

2 5 ft — Exemplar y em bo diments are des^fred'befo^'wk^ 
/4 figures. 

jA Figure 1 -shows a schematic arrangement of component parts for three- 

/V 

dimensional face recognition with digital light and color-image processings 

Figure 2 shews examples of the three-dimensional face recognition on the 

3 0 basis of geometrical data. 



-The right-hand image half of an object surface 7 can be seen in Figure 1. 

<^ Theoretically, the digital micro mirror arrangement 3, which is illuminated with 

fi the light source 1, can generate an arbitrary image at the location of the -objects 7. 

f\ For the purpose of the^invention, however, -an- object 7 -is p r ese n t h e r e t hat is 

5 correspondingly radiated with encoded illumination, so that an encoding 10 

appears on the object 7. The beam path emanating from the light source 1 is 

Pi respectively suitably formed preceding and following a color filter 2 by-^- 

respective optics 4. The color filter 2 is composed of a rotating disk that comprises 

a chromatic, light-permeable strip at the circumference that is uniformly divided 
a . A^e* s Co . CK - 

10 P into -a-red, green and blue -a*#a. ^A^coior image processing is thus enabled. The 

digital light proGessing-9Us-€omposed-of a digital micro mirror-a^ rang e m e nt s-^siG] 



3 



/) 3. This arrangement is what is referred to as a DMD chip (digital micro mirror 
arrangement, digital miro mirror device). -The camera 6 is controlled in addition 
/\ to the light p rocessing 9 with the-control and evaluation unit ll. The projection 
15 of *he- light ensues behind the digital micro mirror arrangement 3 by *he 

projection lens 5 onto the object surface 7. The corresponding light encoding has 
thereby been applied by the digital micro mirror arrangement 3. The camera 6 
must be a color picture camera for a color picture evaluation. 
&~ An encoded illumination is first projected such onto the object 7 via the 

2 0 ft digital mirror-device in the color image evaluation that three striped patterns with 

s< A 

respectively different color (for example, red, green, blue) and periodicity are 
simultaneously present in a video frame. Due to the separate and parallel 
registration of the three different color patterns, the information for calculating 
three depth planes can thus be acquired in a video frame. In order, for example, 

2 5 to assure the evaluation of a face surface within 0. 1 seconds with extremely high 

recognition dependability, this face is illuminated with an encoded, in this case 
ft stripe-like encoding, whereby the stripes exhibit different periodicities in 
successive images. The face is thereby acquired, for example, by 200 x 200 x 150 
picture elements having a spatial resolution of 2 x 2 x 2 mm. The underlying 

3 0 principle of the height measurement at the object 7 is, for example, triangulation. 

The previous problem of a fast switching of the illumination images for the stripe- 



